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' ' TEACHER CHARACTERISTICS AND TEACHING EFFECTIVENESS PF ' 
VOCATIONAL INDUSTRIAL EDUCATION INSTRUCTORS 

« * 

The increased need for skilled and semi-skilled workers has fostered expanded 
recruitment and training of instructors who are capable of imparting occupational 
skills and technical knowledge to youth and adults seeking employment in the indus- 
trial society- Because of this demand it has become necessary to recruit instruc- 
tops frpm sources other than teacher training institutions - often directly from 
industry or from the military. Although these teachers are highly skilled in a 
particular trade area, they lack formal, pedagogical training, particularly those 
professional education courses often cpns'idered essential to satisfactory teac^g^ 
effectiveness. 

Numerous studies have been conducted, in the area o^ teacher effectiveness. 
The results of the studies are very often contradictory. From these studies it 
is difficult to ascertain the effects of formal education upon classroom teaching 
performance. While Pfahl (1971) found a positive, relationship between education 
and performance, Croom (1972) found no rel'ationship^and Musgrove (1968) found a 
negative relationship between the two variables. At is also difficult to conclude 
the effect of trade experience on teaching performance. MusgrpVe (1968) found that 
there was a positive relationship between occupational experience and teacher 
effectiveness when measured^on a teacher self-rating. On the other hand, 'no rela- 
tionship was found between these two variables when teacher perforl^ce was rated 
by supervisors or by students. As far as the teaching experience. is concerned, 
Croom (1972), found that "outstanding" teachers have more years of^ teaching ex^eri- 

• ♦« * ^ 

ence. The resiilt was substantiated with a study by Musgrove (1^68). • - 



There has been a controve;'sy' with regard to the source of teacher" evaluation. 
The argument over whether or^dot administrators and supervisors can. effectively 
rate teaching performance is widespread.' Hedlund (1954) and Johi^on and Radebaugh ^ 
(1969) found that administrators could effectively evaluate and identify superior 
teachers. Newton .(1972) pointed out that supervisors' and aministrators-' eval- 
uations a.re often based , upon the qualities of the teacher rather than ^n^the 
learning outcomes.. Wheti teacher peer ratings are used, Morsh and Wilder (1954) 
found that instructors tended to evaluate their colleagues upon the. amount of sub- 
ject matter which they possessed rather than upon their actual teaching effective- 

/ 
/ 

ness. While Bolton .(1973) favored self-evaluation because "threat" is removed, 
Turner (1971) found that teachers generally rate themselves lower than either supe- 
riors or students. Arguments both for and agaitist the use of student ratings are in 
abundance. For example, Brickman (1966) opposed Studen^t evaluation while GutttKie 
(^954) supported the use of ratings. 

In summary, the previous research studies showed that teachers' background 
characterTstics, namely educational level, trade experience level and teaching experi- 
ence level had different effects on teaching experience. The evaluators, depending 
upon the position they held, put different emphases on teaching effectiveness. A main * 
purpose of the present study was to determine the effects of trade-^experience, teach- 
ing experience, and formal professional education on the classroom teaching perfor- 
mance of vocational industrial education instructors, when the ratings from five sources 
namely a) school administrator (director, principal, assisteint direct^or, or assis- 
tant principal), b) one supervisor (local school division director or supervisor 
of vocational education, general supervisor, or seconda^-y supervisor), c) teacher- 
/peer^ d) one self-rating, and e) students, are simultaneously ana'lyzed. 
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METHOD - • ' ' . 

Instruments: Four instruments w^re developed, one instrument to be used by 
admin i's^^ators (Group 1) and supervisors (Group*^, one by teacher-peers (Group 3), 
one by teachers themselves (Group-4), and the fourth by students (Group 5). A 
committeg^f state and' national experts in ttie field of vocational educatipn provi- 
ded assistance in constructing the i^nstruments. The instruments used by tlTe first 
groups contained seventeen items and the instruments used by the students contained 
sixteen items. Eaoh item was rated 1 to 5 on the^kert type scale. A pilot study 
was conducted to determine test - retest reliability of the instruments. The cor- 
relation coefficients are given in Table 1. 
Subjects 

A 2 X 2*x 2 design wds used in the study. This design represented two levels 
(low and high) of trade experience/ two levels (low and high) of teaching experi- 
ence, and two levels (low and high) of semester hours of professional education. 
Low trade experience and low teaching experience was operationally defined as /0-5 . 
years, while high trade experience and high teaching experience was "defined as 6 or 
raore^years. Low professional education vias established as 0-12 semester hours and 
high professional education was set at 13 or more semester hours. 

A total of '453 trade and industrial education instructors w^re identified 
from among the records of full-i^ime trade teachers in Virginia. Osing a strati- 
fied random sampling technique, 72 instructors (nine in each cell-of the design) 
were selected. Each instructor was evaluated by one school administrator (Group 
1), one school division supervisor (Group 2),. two teacher-peers (Group 3), one 
self^rating (Group .4), and by. one class of students taught by the instructor (Group 
5). Rati-ngs wer? obtained from all five groups on 62 instructors. Of the 432 
rating packets mailed, 406 (94%) were returned and used 'in the data analyses. 




Analysis ^ 

A mean total score of eafch group of Waters was computed for each instructor, 
'I • / ' 

Each instructor then had five measures /of his olassroom teaching performance as 

received from (1) a school administr^or, (2) a supervisor, (3) teacher-peers; 

.(4) a self-rating and (5) students/ ^ • I ,f 

Data from each pf the five groups were analyzed using univariate analysis of , 

/ ' ^ 

variance (ANOVA). Data from alX five ^sources were simultaneously analyzed using 
• / 

multivariate analysis of vari/nce (MANOVA). 

RESULTS 

The means .and standa/d deviations of groups of raters by teachers ^chat*ac- 
teristics, are giyen in /able 2. ^ ' • ' ' 

Analysis of varicm;:e (AnOVA) was usfed.to asriess the effects^of tVade experi- 
ence (T), teaching efxperience (e), and professional education (H) on classroom teach- 
ing performance, wnen rated by individual gr^s of raters. 

. A significa/ce of level of/.05 (a = .05) was'-selected a priori to test the . 
null hypothesesr of equal mean perf(?rm&nce ratings between teacher characteristics. 
'TSible 3 pres.e/ts the results of ANOVA of administrator?' ratings. ' % 

The F /alue of 5.678 for trade' experience was significant (a = .05). There- 
fore the null hypothesis of no difference in the mean ratings between those instruc- 
tors who/have high levels of trade experience was rejected. The findings indicated 
/ 

that S9hO£).l administrators rate differently-those instructors, who have low trade ex- 
perience and those instructors who have high trade experience. 

Table 4 presents the results of ANOVA to test differences in the meari perfor- 
mai/ce ratings given by supervisors. 
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When rated -by suj)ervisoVs, the interaction effects of trade experience (T) 
-and professional, education (H) is significatit at the .05 level, Table 5 presents 
the results of ANOVA to test differences in the mean performance ratings' of ^ 
teacher- peers. ' . > ^ 

When rated by teacher-peers, the differences in the mean performance ratings 
of vocational indus^ial education instructors were not statistically significant 
for any source (a = s05)." * " ' . ^ - 

■ Table 6 pre^nts the results of ANOVA- to tesi the differences in the mean 
performance ratings of vocational incfestrial education instructors using a self- 

rating. . , i . " . ■ ' , 

The differences in theniean performance ratings for ttiose vocational indus- 
trial education, instructors who have low trade experience and those instructors 
who have high trade experience are statistfcally sign:=lf icant y/hen rated bj' in- 
structors on a self-rating. at 'the .05 level.' . ' ^ 

In addition,* the differences in mean, performance ratings for those instructors 
who have a low level of professional .education and those who have a high level of 
professional educat^tfn are statistically significant wher< rated by instructors on 
a seVf-rating instrument at the ,.05 level.' 

Differences in .the .mean performance ratings assigned by students were not^ . 
statistically significant at the' .05 level. The analysis of variance for students 
is presented in Table 7. - . ' . , ■ 

When the ratings from the five groups were analyzed simultaneously, the 
results of MANOVA showed tfiat none of the effects \iete significant. MANOVA in- ' 
dicated that when 'the'total profile 'of teaching effectiveness was obtained from- 
all sources, there were no. significant differences among the instructors, "fable 

' : ' • 

8 shows the results of MAflpVA. 



/ 
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I-MPLI CATIONS ' . • . •■ 

The results of this study indicated tha.t years of teaching experience was not- 

emphas'ized by any group of paters. The variable which had the greater effect on 

the ratings given by the five groups was trade experience, as expressed by admin- 

» • • *•» 

istrators and teachers themselves. Professional 'educa^on was emphasized by 
teachers on a self-rating. Students failed to emphasize!^ any one particulao^, ,vari- 
elble. Most of the students might not have been familiar with the qualifications- 
of trade instructors, consequently, their evaluations were most li-kely based on 
"true" teaching effectiveness. ' As the results indicate, the background character-* 
Tstics of instructors did not make a ^difference in the ratings given by studenjs*^ , 
Teacher-peer ra4;ings also indicated that the variables of trade experience, teach- 
-ing experience and professional education do not significantly influence the 
ratings of fellow teachers. Multivariate analyses further substantiated this . 
observation, . , 

^ Teacher certification" requirements for vocational industrial education in- 
* struCtors. requires both, trade experience and professional education. This study, 
sfiows that trade experience* and professional education do not contribute to teach- 
ing effectiveness from the point of view of students, teacher-peers, and when all 
five rating groups^^were combined. This finding should be takeh into consideration 
in the teacher certification process of vocational industrial education instructors. 
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Table 1 



Pearson Product Moment Correlation Coefficients for; 
Reliability of bating Instruments 



• Type of Form 


* 

Number of Raters 


Rel*1ab^*Jity 


Administrator* 


n-10 


r=.925 


Supervisor* 


„ . n=10 


r=.932 


• 

Teacher-Peer 


n=ll 


'r=.828 


Self-Rat jng 


n=U 


r=.919 


Student 


n=60 


r=.701 


*Same form 

\ 

\ 
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. Table 3 _ 
Analysis of Variance of Ratings by Administrators 



Source 




MS 1 
1 


F 




T - . 


\ 

1 


,l.'5i9 


/ 5.678* 




E 


1 




nop 




■• ■ H 


1 


>259 . 


.9.68 




TE 




•. .232. 


.^66 




•TH , 




.255 


.952 ' 




EH 


1 


- .276 


1.030 




TEH 


1 


.646 


2:416 


f 


ERROR ' 


54- 


.267 






TOTAL 


61 









♦Significant at .05 level 
1 • ' 



Table 4 



Analysis of Variance of Ra^tings-by Supervisors 











Source 


df 


■ MS 


F 


T 


1 ■ 


..615 ' 


-2.144 


E 


■ . 1 . 


.0'59 


.205 


■t H 




.58& 


- 2.041 


TE • 




.004 


.013\ ■ 


TH . 




r.301.- 


■4.53D* 


■ EH 




.585 ■ 


2.039 


TEH " 




.017- 


■ .060 


' ERROR 


■J 54 


.287 


: \ 


, TOTAL 


61 







*Si.gnificant at .05 level 

t, ■• 
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Table 5 < ,\ 
Analysis of Variance of Ratings by Jeacher-Peers 



Source 


. df 


i . 

■ ' MS 


F 




1 • 


.633 


2.195 




•1 


. .146. ~ 


\ .506 


H ' • 


1 , 


.008. 


.02^ 


" ■ ■ TE. : 


1 


- ^ .019 


.065 * 






■ .347- 


1.205 


■ EH . 


. 1^ 


.137 


' .476 ' 


TEH 


1 


,.03,8 


.132 


ERROR 


54 


.288 




• TOTAL ' 

1 ^ 









Jable 6 

Analysi's of Variance of Self-Ratings 



Source ' 


. df . 


MS 


^ F 


T ' , 


r 


'i 

. *ri.4ir ' . 


6,500* 


E 


1 


\ .065 


.300 


■ H 




l.OOi • 


4.614* • 


TE*.. 


1 


-.082 


^ .378 


TH 




.013 


.060 


: m • - 


1 


.216 ■ ^ 


■ " .997 


TER • 




- .010 


- .048 . 


• ERROR 


> 54 . * 


\ . .217 ' ■ 


•..048 


TOTAL , 

















■*sVgnif icant at i05 level 
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Table 7 • - 

Analysis ofoVarlarrce of Ratings by Students 



Source 


df 




F . " 


\ 






- - .125 


1.3^9 




E • ■ , 




.344 . 


3.711 




.H J 




.010 


. 112 ' 


i 


TE ■ ^ 




.227 • 


2.447- •- 




- TH; ^ 




- - . 166' 


1.788 




EH . 




.045 - 


.483 




TEH 




.050 


.537 • ' 




ERROR ■ ' 


54 


- .093 


.537 




TOTAt 


61. 




* 
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Table 8 \ - . «^ 

Mullivariate Test's ^of Significance for 
Simultaneous Group- Ratings 



Source " df - F 



- T . ■ (5,50) 2.215 

* . E ■ • ~ (5,50) • 1.172 

• H (5,50 ■ . 1.506 

TE ' (^5,50) .896 

, TH ' . ** . (5,50) , . L.348 

EH • • (.5,50) * .686 . 

V TEH .' , (^,50) •• -.BIQ 
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